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ABSTRACT 


v 

In  this  report  techniques  are  described  for  the  computer  analysis  of  the  series  of  pho¬ 
tographs  of  specific  cloud  scenes  taken  from  the  orbiting  space  shuttle.  A  method  for  ex¬ 
tracting  high  resolution  navigational  information  from  the  space  shuttle  hand-held  camera 
imagery  has  been  developed.  Also,  methods  are  applied  which  differentiate  cloudy  from  clear 
areas  with  both  ocean  and  land  backgrounds  and  over  a  wide  range  of  viewing  geometries. 

Three  specific  objectives  are  achieved: 

1.  Develop  and  implement  high  resolution  digitization  of  the  photographic  transparen¬ 
cies  so  they  can  be  automatically  processed  by  the  computer.' 

2.  Develop  and  implement  rectification  techniques  that  will  provide  angle  from  nadir, 
geographical  and  scale  information  that  can  be  associated  with  each  feature  on  the 
transparencies.' 

3.  Apply  a  statistical  cloud  classification  technique  to  assess  the  amount  and  the  spatial 
variability  of  the  cloud  fields. 

This  work  should  be  carried  forward  in  Phase  II  to  produce  a  fully  operational  method¬ 
ology  to  enable  the  benefits  of  this  research  to  be  realized  in  a  real-time  assessment  environ¬ 
ment.  Cloud  properties  studies  can  provide  a  potentially  valuable  new  tool  for  improving 
weather  prediction  and  meteorological  assessment  studies.  - 
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Introduction 


The  basic  demonstration  made  in  the  work  reported  on  here  is  the  increase  in  value  and 
utility  of  cloud  data  extracted  from  the  monochrome  transparencies  taken  by  crew  members 
of  the  space  shuttle  with  a  hand-held  camera.  (Details  on  camera,  lens,  film.  etc.  are 
contained  in  Snow  and  Tomlinson,  1987-  Reference  [I j )  Numerous  photographs  taken  during 
space  shuttle  missions  in  1984  and  1985  have  been  digitized  and  rectified.  Also,  a  proof-of- 
concept  study  to  demonstrate  the  feasibility  of  using  a  statistical  cloud  classification  method 
to  assess  the  amount  and  spatial  variability  of  cloud  fields  have  been  completed. 

The  fact  that  space  shuttle  photographs  were  taken  with  the  high  resolution  film,  which 
results  in  high  resolution  digital  images,  has  been  exploited  in  the  analysis.  Three  specific 
technical  objectives  which  have  been  completed  are  reported  on: 

1.  Develop  and  implement  high  resolution  digitization  of  the  photographic  transparen 
cies  so  they  can  be  automatically  processed  by  the  computer. 

2.  Develop  and  implement  rectification  techniques  that  will  provide  angle  from  nadir, 
geographical  and  scale  information  that  can  be  associated  with  each  feature  on  the 
transparencies. 

3.  Apply  a  statistical  cloud  classification  technique  to  assess  the  amount  and  the  spatial 
variability  of  the  cloud  fields. 


Major  Results 

These  objectives  have  been  pursued  using  series  of  images  of  cloud  fields  taken  with  a 
35mm  camera  aboard  the  space  shuttle  “Discovery”.  The  results  are  illustrated  in  the  main 
body  of  the  report  using  the  series  of  photographs  taken  offshore  of  Cape  Canaveral.  Florida. 
In  Appendix  A  and  B  results  for  the  other  series  are  presented.  Information  on  the  location 
of  each  series  is  here  given. 


Location 

Approx. 

latitude 

(°N) 

Area 
Analyzed 
(sq  km) 

Underlying 

Surface 

Month 

/Year 

Local  Solar 
Time 

Cape  Canaveral,  Florida 

28 

7000 

offshore 

01/85 

mid-afternoon 

Maui,  Hawaii 

21 

1300 

land 

01  '85 

lat  e-  forenoon 

Gran 

Canaria,  Canary  Isis 

28 

1400 

land 

01  85 

mid  afternoon 

Gran 

Canaria,  Canary  Isis 

28 

2400 

offshore 

01  85 

mid  afternoon 

Digitization 


The  initial  step  was  to  select  from  each  series  approximately  20  images  from  the  35mm 
positive  contact  transparencies  provided  (see  Figure  la)  with  the  aid  of  large  positive  prints 
(see  Figure  lb).  For  (he  best  utilization  of  the  data,  each  35mm  transparency  was  enlarged 
into  a  high  resolution  transparency  to  be  used  with  Optronics  P-1000  scanner  (see  Figure 
!<•)• 

Next  the  digitization  of  the  black  and  white  transparencies  was  carried  out  on  an  Op¬ 
tronics  P-1000  scanner  connected  to  the  bus  of  a  VAX-1  1/750.  A  brief  description  of  the 
digitization  technique  used  by  Optronics  scanner  is  provided  in  the  Appendix  0. 


Picture  of  the  Optronics  drum  scanner  P-1000 


The  whole  sequence  of  20  images  was  scanned  3  times  on  an  Optronics:  first  pass  es¬ 
tablished  the  dynamic  range  of  the  data  transparencies,  thus  finding  the  greatest  common 
range  of  gray  scale  values;  second  pass  performed  digitization  at  50  micron  resolution  and 
filial  third  pass  was  using  25  micron  resolution.  The  table  below  presents  the  results  of  the 
last  two  passes. 


i 

i 

50  uni  runs 
rev  >1  u  I  ion 

25  microns 
resolution 


Or;  jin.il  image  is  1  1 3mm  ■  72mm  film  , 

1 

2200  ■  I  1  ID  pixels  .3.25  MByte  image 

at  250  gray  levels 

■1520  ■  2HH0  pixels  13.02  MByte  image 

at  25(1  gray  levels 


All  of  the  steps  in  the  pr<><  ess  of  digitization  described  above  involve  a  degree  of  uncer 


tainty  and  error.  Simply  finding  the  best  overall  dynamic  range  of  a  group  of  transprencies 
involves  a  lengthy  procedure  of  sampling  and  experimentation.  The  st  ep  involving  the  change 
from  the  analog  signal  of  the  laser  beam  to  the  sampled  digital  signal  varies  in  allowed  errors, 
depending  on  the  resolution  of  the  step,  thus  allowing  for  a  trade-off.  There  are  a  number  of 
choices  to  be  made  in  the  search  for  the  best  scanning  strategy,  e.g..  the  problem  of  scanning 
an  image  at  too  high  resolution  and  coming  up  with  the  actual  grains  of  the  film  instead 
of  meaningful  information.  The  goal  of  the  present  effort  is  achieved  by  scanning  several 
sequences,  but  even  more  so  a  foundation  for  further  work  was  laved  as  plans  evolved  for  a 
knowledge- based  system  that  will  govern  work  with  different  sets  of  images  and  will  help  to 
determine  automatically  the  most  appropriate  techniques  and  procedures. 

Processing  always  began  with  50  microns  resolution  data,  due  to  the  image  size,  though 
all  final  analysis  was  accomplished  25  micron  resolution  data.  To  obtain  more  compact 
images  an  adaptive  filtering  technique  was  implemented  using  2*2  and  3*3  blocking  (see 
Figure  2).  The  scan  file  for  each  image  yields  a  run-length  encoded  file  on  the  VAX  computer. 
For  the  better  visualization  of  the  data,  a  histogram  equalization  algorithm  was  employed. 
Since  the  original  range  of  the  gray  levels  does  not  span  the  entire  scale  of  8-bits  (0  to  255). 
contrast  enhancement  was  performed.  If  an  image  G  has  N  (in  this  case  N  =  25ti)  gray  levels, 
let  h(n),  for  n=l,...,256  be  normalized  histogram.  Then  define  the  cumulative  histogram 


ff(n)  =  £/»(«)• 


.=o 


The  adjustment  rule  is 


G'  -  H(n)  *  G,  for  G  -n 


The  example  of  the  gray  scale  histogram  before  and  after  equalization  is  presented  in  F  igure 
3.  As  histograms  demonstrate,  all  features  of  the  original  image  are  preserved.  Equalization 
greatly  enhances  visual  perception  of  data.  The  above  technique  was  used  due  to  uneven 
optical  density  of  individual  transparencies  that  comprised  the  sequence. 


Navigation 

In  order  to  make  full  use  of  the  digitized  space  shuttle  cloud  photographs,  the  exact 
geographical  location  of  each  point  on  the  image  and  the  exact  scale  of  each  picture  element 
(pixel)  must  be  known.  Since  all  the  photographs  were  taken  from  one  of  the  space  shuttle 
windows  at  some  angle  relative  to  nadir  (see  Figure  4),  they  possess  some  degree  of  deforma 
tion  relative  to  the  map  plane,  which  varies  with  position  on  the  photograph.  Thus,  both  the 
geographical  location  and  the  scale  of  each  pixel  must  be  computed  from  orbital  and  camera 
information.  The  first  step  is  to  determine  the  viewing  geometry.  Ihe  viewing  ge«>metr\ 


avaiable  a)  the  onset  of  the  present  work  did  not  account  for  the  lens  of  the  camera  and  for 
an  inherent  distortion  within  an  image.  The  above  geometry  was  modified  to  account  for 
the  presence  of  a  thin  lens  mechanism  that  more  correctly  reflects  the  physics  of  the  camera 
used  in  the  shuttle.  The  geometry  and  associate  formulas  for  a  thin  lens  are  given  in  Figure 

5. 

At  this  point  the  navigation  and  rectification  procedure  begins.  Since  the  exact  position 
or  the  viewing  angle  of  the  camera  is  not  known,  the  computations  of  the  geographical  and 
scale  information  therefore  require  some  interactive  work,  whereby  the  viewing  geometry  at 
the  time  of  the  photograph  is  determined.  Next  is  employed  a  software  package,  which  Chase 
Consulting.  Inc.  developed  over  the  last  few  years.  The  package  named  “PLANET”  allows 
the  computations  and  visualization  of  any  field  of  parameter  on  a  planet  as  viewed  from  an 
orbiting  sensor.  This  software  performs  two  important  tasks: 

1.  Re-map  on  the  sphere  (or  ellipsoid)  a  field  of  gridded  data, 

2.  Computationally  simulate  the  viewing  of  this  field  from  space  as  a  function  of  a 
position,  viewing  direction,  lens,  light  sources,  etc. 

As  an  example,  if  the  field  displayed  is  the  surface  topography  and  we  assume  that  there 
is  no  water  over  ocean  floor  surface,  and  under  the  following  geometrical  conditions: 

1  )  Satellite  (or  platform)  in  equatorial  orbit  with  subpoint  (90°W,0°N), 

2  I  Sun  at  45'  (zenith  and  azimuth)  from  satellite  location, 

t h -’ii  the  resulting  visualization  from  the  package  PLANET  is  that  presented  in  Figure 

t;. 

Csirtg  the  PLANET  package,  we  can  also  re-map  in  spherical  and  viewing  coordinates 
any  coastline  composed  of  a  data  set  of  points.  The  ccssline  values  we  had  an  access  to, 
had  the  highest  resolution  of  3-5km,  came  from  the  SPSS  package  (see  Figure  7a  for  the 
sample  of  the  coastline  of  Florida  1.  The  data  set  for  regions  not  in  the  SPSS  coastline 
database,  were  generated  by  digitization  from  a  large  scale  chart.  One  such  example  is  given 
for  (.ran  Canary  Island  in  Figure  7b.  with  the  data  points  taken  from  the  high  resolution 
nautical  chart  (the  (Iran  Canary  coastline  is  sketchy  because  only  a  few  specific  features 
of  the  distinctive  coastline  are  needed  and  not  necessarily  an  exact  duplicate  of  the  entire 
coastline !. 

PLANE  1  system  requires  the  following  input  to  be  present: 
at  Camera  coordinates  and  directions: 


CAMERA  POSITION: 
CAMERA  DIRECTION: 


X.Y.Z 

X'.Y'.Z'  -  vector 


HIHHN 


m 


CAMERA-UP-DIRECTION: 

X",Y",Z"  -  vector 

b)  Textures: 

op  to  3 

TEXTURE-FILE: 

name  (on  input ) 

up  to  3 

TEXTURE  SIZE: 

X  value. Y  value 

up  to  3 

TEXTURE-SPAN-LOW: 

lat,lon  (in  degrees) 

up  to  3 

TEXTURE.SPAN-HIGH: 

lat,lon  (in  degrees) 

up  to  3 

TEXTURE  POSITIVE: 

range 

up  to  3 

TEXTURE-NEGATIVE: 

range 

up  to  3 

PSCALE: 

color -range  (on  output) 

up  to  3 

NSCALE: 

color-range  (on  output) 

up  to  3 

BUMP  MAPPING: 

yes/ no 

BACKGROUND-COLOR: 

value 

MISSING-VALUES-COLOR: 

value 

c)  Lenses: 

DISTANCE-TOSCREEN: 

value  (in  units) 

SIZE  OF  SCREEN: 

value  (in  units) 

SCREEN  SIZE: 

X  value. Y  value  (pixels 

MATERIAL-CONST: 

value  (0.  to  1.) 

FOCAL-LENGTH: 

value  (in  mm) 

d)  Reflectivity,  directional  and  ambient  lights: 

up  to  3 

LIGHT-DIRECTION: 

X,Y,Z  -  vector 

up  to  3 

REFLECTION  COEF: 

value  (in  percent ) 

AMBIENT-LIGHT: 

value  (in  percent ) 

e)  Navigation: 

LONGITUDE-AT -X-AXIS: 

value  (in  degrees) 

AUX-FILE: 

name  (output:  long.lat ) 

f)  Coast  line  and  vector  input: 

COAST-FILE: 

name  (input,  or  default ) 

COAST-TYPE: 

value  (1  to  3) 

COAST  SCALE: 

range  (on  out  put -color ) 

g)  Animation  option:  MOVIE 

(A  more  detailed  manual  of  DLANET  package  can  be  provided  upon  request  H<  |< 

13]). 


■  ^ VifV  V-  a 


As  the  result  of  the  PLANET,  an  image  for  display  and  auxiliary  files  containing  (lat,lon) 
pairs  for  each  pixel  of  t  he  image  are  generated.  Now  the  task  is  to  align  the  coastline  produced 
l>y  PLANET  with  the  image  of  the  coast  seen  on  the  shuttle  image.  This  is  done  through 
t he  visual  minimization  for  the  verification:  the  various  input  parameters  are  iteratively 
modified  until  the  best  fit  (about  1  pixel)  is  found.  All  computations  end  up  accurate  to 
.001  of  1  degree,  or  approximately  1km  (100m)  navigation  (equivalent  to  1  pixel).  In  order 
to  speed  the  iterative  process  a  pre  processor  to  PLANET  has  been  developed  in  which: 
inputs  are: 

h  (km)  -  first  estimate  of  the  orbit  height, 

a'  (latjon)  -  shuttle  subpoint, 

I)  (latjon)  -  target  (i.e.  center  of  the  image), 

s  ( degrees  |  -  skewing  of  the  camera  (see  Figure  4), 


2 


-  image  of  the  roastline. 

Once  the  coastline  image  is  computed  with  PLANET  from  the  set  of  best-guess  pa¬ 
rameters.  it  is  displayed  superimposed  upon  the  original  cloud  image  for  assessment  of  the 
match.  I  he  difficulty  is  to  assess  which  parameter  to  modify.  To  facilitate  the  choice  a 
sequence  of  images  are  processed  at  once,  with  the  same  orbit  altitude  and  other  param¬ 
eters.  \\e  slop  at  one- pixel  accuracy,  for  examples  see  Figures  8a  and  8b.  To  achieve 
such  a  precise  match  requires  on  average  25-80  trials.  It  is  desirable  to  automate  the 
above  procedure,  as  it  is  not  practical  to  spend  such  an  amount  of  labor  on  navigation 
of  a  large  set  of  images.  The  rules  by  which  an  interactive  navigation  procedure  is  gov¬ 
erned  are  straight  forward  and  therefore  such  navigation  will  be  implemented  in  an  AI 
i  knowledge  based  i  en\ironment  in  the  follow  on  effort.  The  set  of  steps  is  presented  below: 

Mapping  "I  computer  generated  coast  lines  with  actual  roast  lines: 

1.  Input  longitude  and  latitude  of  the  center  of  an  actual  image, 

2.  Input  altitude  of  the  orbit. 

’  \djust  parameters  to  at  fiieve  the  proper  focal  length  of  the  camera  used  (distortion 


around  the  edges  is  monitored), 

For  Images  Close  to  Nadir: 

4.  Adjust  the  camera-up  position  to  correct  for  skewing.  It  is  either  clockwise  or 
counter-clockwise,  and  the  camera-up  vector  allows  just  such  an  adjustment. 

5.  May  require  adjusting  altitude  of  the  orbit  for  a  proper  fit. 

For  Oblique  Images: 

4'.  All  camera  position  are  on  the  orbital  sphere, 

5'.  If  generated  image  is  larger  than  required,  then  must  move  closer  to  nadir  position. 
Here  we  use  the  size  of  the  image  for  the  selection  criteria  in  the  determination  of 
oblique  shots. 

6.  Movement  parallel  to  the  coast  line  will  result  in  the  skew  adjustment.  Here  we  use 
the  geometry  of  the  coastline  to  determine  the  skew  adjustment. 

7.  If  movement  of  the  camera  position  to  adjust  skewing  results  in  the  improper  size 
change  then  use  camera-up  to  adjust  skewing.  Here  we  use  the  change  c.f  size  of  the 
feature  on  the  surface  to  adjust  skewing. 

8.  Adjust  target  longitude  and  latitude  to  offset  the  whole  image. 

9.  Procedure  takes  about  25-30  iterations. 

Using  the  above  technique,  the  focal  length  of  camera  has  been  empirically  obtained  to 
be  about  105mm.  After  a  successful  match  the  AUXILIARY  file  containing  a  flat  .Ion)  pair 
for  each  pixel  of  an  image  is  produced.  The  process  was  repeated  for  each  image  of  the 
sequence. 

For  the  purposes  of  navigation  and  angle  determination  the  entire  sequence  of  images 
was  processed  from  which  the  following  table  is  compiled: 


Cape  Canaveral  Offshore  Sequence 
300  km  orbit 


image  # 


2 

3 

4 

5 

6 

7 

8 
9 


camera 


lat  (N)  !  long  (W) 


28.35 

28.35 

28.30 

28.30 

28.29 

28.30 

28.30 

28.31 


80.42 

80.35 

79.76 

79.52 

79.11 

78.66 

78.19 

77.62 

77.38 


target 

lat  (N)  |  long  (VV) 


28.350 

28.357 

28.335 

28.335 

28.320 

28.320 

28.310 

28.300 

28.290 


camera  up  vec 

X  I  Y 


tor 

Z 


vi  < 

(d 


vv  angle 
egrecs ) 


80.425 

0.0 

1.0 

0.18 

3.1  1 

80.455 

0.0 

1.0 

0.21 

3.72 

80.515 

0.0 

1.0 

0.08 

14.72 

80.511 

0.0 

1.0 

0.07 

18.98 

80.481 

0.0 

1.0 

0.05 

25.37 

80.470 

0.0 

1.0 

0.05 

32.0't 

80.500 

0.0 

1.0 

0.03 

3X.76 

80.500 

0.0 

1 .0 

0.00 

15.20 

80.460 

0.0 

1.0 

0.01 

47.20 

U.O 

1.0 

51.  Ml 

0.0 

1.0 

0.00 

62.2* 

1.0 

0.00 

67  lit 

t  n 


oo  on 


16.51 

15.43 

14.64 


28.250 

28.190 

28.130 


Since  from  this  table  we  can  make  a  plot  of  the  orbit  subpoint  sequence  (see  Figure  9),  we 
can  improve,  if  necessary,  our  previous  results  on  the  angles  by  constraining  the  sequence  to 
be  smooth.  Then  we  can  go  back  to  our  procedure  and  modify  the  appropriate  parameters. 
Once  the  navigation  auxilary  files  are  created  for  each  image  in  the  sequence  we  can  proceed 
to  the  next  step  -  the  analysis  of  cloud  coverage  as  a  function  of  viewing  angle. 

Region  Determination 

Essential  to  the  analysis  is  the  selection  of  an  optimum  region.  This  means  a  region  which 
lias  reasonably  uniform  cloud  cover,  appears  in  all  images  of  the  series,  has  good  film  quality 
(no  scratches,  etc.)  and.  at  least  for  this  first  series  to  be  analyzed,  is  not  contaminated  by 
a  land  background.  Foi  statistical  significance  the  region  should  be  as  large  as  possible,  in 
any  case  not  smaller  than  1000  sq  km.  Under  these  constraints  the  procedure  is: 

a )  choose  points  to  form  a  closed  polygon  by  hand  on  the  original  image  closest  to  nadir, 
see  Figure  12, 

i>)  compute  using  the  AUXILIARY  navigation  files  of  PLANET  the  corresponding 
boundary  points  on  the  other  images  in  the  series,  see  Figure  11  , 

(  loud  A  naivsis 

The  main  step  in  the  analysis  is  to  distinguish  the  portions  of  each  region  which  are 
■  [ear  from  those  covered  by  clouds.  Several  methods  are  possible,  e.g.  singe-line  gray  level 
thresholding,  gray  level  gradient  thresholding  or  spatial  homogeneity  analysis.  Although  in 
principle  any  of  t hese  could  be  completely  automated,  at  present  each  still  requires  interactive 
image  processing.  To  better  appreciate  the  problem  single-line  cross  sections  of  gray  levels 
are  presented  in  Figure  12  ar.c  13-  '  :'.e  following  feavurec  are  roled: 

clouds  I  large  gray  values), 

■  sunglint  effects  (low-medium  gray  values:  refer  Figure  12,  columns  232-240). 
cloud  shadows  (refer  Figure  12,  columns  209-211,  203-204) 
clear  regions  (refer  Figure  1  ,  columns  203-206) 

Hy  selecting  particular  subsets  of  the  region  being  analyzed,  certain  of  these  features  can 
be  highlighted.  In  Figure  1  •  is  shown  a  sunglint  and  in  Figure  t~b  an  example  having  only 
cloud  and  clear  spaces  over  water  is  given.  A  simple  threshold  value  determined  from  the  raw 
information,  such  as  Figure  12  would  not  be  appropriate  since  it  would  either  include  the 
sunglint  areas  as  cloud  if  it  were  too  low  or  would  exclude  some  clouds  if  too  high.  Therefore 
two  other  approaches  have  been  investigated. 
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Gradient  threshold  technique 


One  approach  to  finding  a  threshold  value  is  to  utilize  the  gradient  technique.  A  gra 
dient  image  isrcade,  Fig.  15.  Assuming  that  cloud  edge  has  a  higher  gradient  value,  an 
upper  cumulative  10%  of  gradient  values  are  taken  and  the  mean  and  sigma  values  of  llio 
contributing  pixels  are  found.  Assuming  Gaussian  distribution  of  gray  values  and  taking  into 
account  actual  distribution  of  glint  region  in  the  images  we  take  a  threshold  value  to  be  the 
mean  minus  half  of  sigma  (see  Figure  16).  The  only  limitation  with  this  method  is  linked  to 
the  subjectivity  of  the  choice  of  the  gradient  cut-off.  In  the  present  example  it  corresponds 
to  a  gradient  value  >60,  but  as  can  be  seen  there  are  clouds  which  have  smaller  gradient 
values  than  that.  It  is  anticipated  that  this  method  will  slightly  underestimate  the  cloud 
cover  (about  2-5%  underestimation).  The  results  or  this  method,  which  were  confirmed  by 
the  method  next  to  be  discussed,  for  the  Cape  Canaveral  sequence  are  compiled  below. 
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Results  of  Cloudiness  vs  Viewing  Angle  Study 
Cape  Canaveral  Offshore  Sequence 


image  # 

gradient 

cutoff 

- - - 

|  mean 
!  gray 

level 

sigma 

(<r) 

mean-.5cr 
gray  level 

percent 

cloudiness 

angle 
in  degr* 

2 

53=90.28 

!  173 

32.68 

157 

60.80 

3.14 

3 

52=90.21 

178 

31.93 

162 

61.52 

3.72 

4 

52=90.21 

1  177 

31.55 

i  161 

64.31 

14.72 

5 

52=90.29 

181 

32.54 

165 

66.06 

18.98 

6 

52  =  90.23 

173 

31.74 

157 

65.99 

25.37 

7 

50=89.87 

175 

30.73 

160 

67.10 

32.09 

8 

36=89.73 

|  178 

24.97 

!  166 

71.11 

38.76 

9 

53=89.97 

186 

31.59 

170 

71.47 

45.20 

10 

53=89.76 

;  182 

31.13 

166 

72.13 

47.20 

12 

52=90.03 

i  168 

30.39 

153 

70.38 

54.80 

14 

46=90.19 

179 

28.61 

165 

83.75 

62.2'' 

1G 

48=90.41 

183 

28.38 

169 

86.88 

67.1 0 

Horizontal  homogeneity  method 

The  second  method  we  have  investigated  is  the  so-called  horizontal  homogeneity  method 
of  Coakley  and  Bretherton  (Reference  (2j).  It  was  originally  developed  for  AYHRR  1R  data, 
but  we  have  re-applied  it  to  the  data  provided  from  the  space  shuttle  experiments. 

We  take  the  view  here  that  the  clouds  are  primarily  observed  as  irregularly  shaped  and 
sometimes  highly  structured  objects  against  a  relatively  uniform  background.  This  view 
leads  to  what  might  be  called  operational  definitions  for  the  terms  cloud  cover",  "clear  sk\  . 
and  ’cloudy  sky’  over  certain  scale  of  pixels.  The  procedure  for  identifying  the  cloud  co\»*r 
layer  is  best  described  through  example.  Consider  a  5  -  5  box  of  pixels  taken  from  an  original 
image.  We  will  compute  the  mean  and  variance  values  for  the  box.  and  then  moving  such  a 
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box  in  1  pixel  increments  over  an  image  we  will  obtain  our  Figures  17  and  18,  for  boxes  5x5 
and  7>7  respectively  (in  Figures  each  point  corresponds  to  a  box  of  pixels). 

Figures  17  and  18  show  a  structure  that  we  will  term  an  arch.  Such  arches  turn  out 
to  be  characteristic  of  local  mean  versus  local  standard  deviation  plots  for  the  shuttle  data. 

The  cluster  of  low-variance  points  with  low  mean  (left  foot  of  an  arch)  is  interpreted  as 
representing  the  cloud-free  scan  spots,  which  in  this  case  are  clear  regions  over  ocean.  The 
cluster  of  low-variance  points  at  the  right  foot  of  an  arch  is  interpreted  as  representing  the 
completely  covered  scan  spots.  We  interpret  the  points  in  the  body  of  the  arch  between  the 
two  clusters  as  representatives  of  partially  filled  fields  of  view.  This  interpretation  appears 
to  be  reasonable  in  that  we  would  not  expect  partially  filled  fields  to  exhibit  sufficient  local 
coherence  or  homogeneity  to  bring  local  variance  as  low  as  in  cases  of  cloud-free  or  cloud- 
covered  conditions.  The  limitation  of  this  technique  is  that,  in  order  to  be  identified  as  a 
cloud,  image  must  be  uniform  over  regions  somewhat  larger  than  a  box  (5x5).  The  high 
resolution  of  our  data  (2880*4520  pixels)  allows  us  to  have  statistical  significance  in  this 
method  of  analysis,  and  not  miss  any  small  clouds. 

By  looking  at  the  thickness  (or  number)  of  boxes,  that  are  below  certain  variance,  we 

•  an  both  get  an  idea  of  the  cloud  size  and  cloud  cover.  Basically  a  mean  value  that  is  to 
the  immediate  right  of  the  left  arch  foot  is  considered  to  be  a  cloud  cover  cutoff.  Once  this 
number  is  found,  we  can  go  back  to  the  original  image,  and  for  each  pixel,  centering  a  box 
around  it.  we  determine  whether  computed  values  are  above  the  threshold  or  not.  That 
makes  our  rule  for  cloud  cover  determination  under  a  homogeneity  method. 

Plots  for  the  cases  of  variance  less  than  5  and  lower  mean  (i.e.  left  foot  of  an  arch,  which 
signifies  the  clear  region)  are  given  in  Figures  19  and  20.  Some  of  the  interesting  features 
can  be  found  in  similar  plots  for  another  series  we  have  worked  with.  In  Figures  46  and 

I  we  can  identify  three  peaks  present,  which  stand  for:  cloud  shadow,  clear,  and  sun-glint 
regions,  in  order  of  increasing  mean. 

Ait  overall  advantage  of  homogeneity  approach  is  that  we  can  get  both  cloud  coverage 
and  mean  cloud  size  at  the  same  time.  The  method  itself  can  be  easily  extended  to  include 
""me  other  simple  statistics  applicable  to  a  certain  box  size,  which  is  intented  under  Phase 

I I  effort 

t  snig  the  method  described  above  we  have  performed  the  cloud  coverage  computations 
'and  'l"ud  "i  70 1  and  plotted  that  as  a  function  of  viewing  angle  (see  Figure  19)  for  the  ' 

i  ape  t  auareral  sequence  along  with  those  discussed  in  Appendices  A  and  B.  The  agreement  J 

between  rev  u  1 1 «  obt  ai  tied  with  the  first  and  second  method  was  impressively  good  -  thresholds  j 

did  not  \ary  by  more  then  .75  value  on  the  gray  scale. 

1  he  same  complete  analysis  as  described  above  has  been  performed  on  3  more  sequences. 

•  oiupiete  set  of  results  and  supporting  plots  are  in  Appendices  A  and  B  for  sequences  of  ' 

Mam  and  (Iran  <  anary  Islands  respectively.  | 

i 
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Future  Work 


Several  refinements  of  the  two  approaches  presented  above  in  cloud  analysis  are  possible. 
One  which  seems  especially  attractive  is  to  improve  the  definition  of  the  edge  (the  border 
between  the  cloud  and  shadow  or  background)  by  performing  the  analysis  using  overlapping 
boxes  in  the  narrow  strip  or  sub-domain  which  includes  the  edge.  Recent  publications  on 
the  subject  of  sub-pixel  analysis  also  offer  alternatives.  The  natural  step  for  improving  the 
spatial  homogeneity  technique  is  to  include  not  only  the  mean  and  variance,  but  second  and 
third  statistical  moments,  entropy,  minimum  and  maximum  values  in  the  box  analysis.  The 
precise  knowledge  of  our  position  and  image  navigation  also  allows  the  computation  of  Sun 
position  and  thus  locate  any  possible  sunglint  off  the  surface.  The  analysis  can  be  relined 
by  removing  the  sunglint  from  an  image  before  the  statistical  cloud  computations  are  done, 
based  on  the  geometry  and  conditions  of  the  surface. 

The  results  presented  above  appear  to  be  extremely  promising  with  respect  both  to  the 
feasibility  of  the  proposed  technique  and  to  its  potential  value  of  information  derived.  The 
conclusion  is  that  the  original  concept  of  digital  analysis  of  these  cloud  images  is  indeed 
viable,  and  that  proceeding  to  develop  it  to  a  practical  technology  is  justified.  The  results 
have  also  pointed  the  way  to  a  number  of  improvements  and  extensions. 
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Figure  1.  Original  Image  Sequences 


Figure  la.  Original  Sheets 


Figure  lb.  Photographs 
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Figure  6  Example  of  PLANET  package  output 


Figure  7  Examples  of  PLANET  package  output  of  the  coastlii 
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Navigation  over  Cape  Canaveral 
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Fi E; u r e  11  Example  of  the  region  determination  of  successive  images 


Gray  Value  Distribution  —  row  270  —  Cape  Canaveral  No. 3 
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Fiirure  14  Cumulative  histogramms  for  glint  and  cloud  regions 
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Figure  15  Example  of  the  gradient  and  thresholded  image 
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Cloud  Cover  vs.  Viewing  Angle 

Cape  Canaveral  Maui  Island 
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APPENDIX  A 


Maui  sequence 

The  complete  analysis  described  in  the  report  was  also  performed  on  a  sequence  of  images 
taken  during  space  shuttle  mission  51C  close  to  Maui  Island,  Hawaii.  Twenty  images  were 
taken  and  navigation  analysis  produced  a  following  table 


Flight  51C  Shuttle  “Discovery” 
280  km  orbit 


image  # 

camera 

1 

target 

camera  up  v 

ector 

angle 

lat  (N) 

long  (W) 

lat  (N) 

long  (W) 

X 

Y 

Z 

in  degrees 

1 

'  21.60 

156.52 

20.820 

156.520 

0.0  1 

-0.16 

-1.0 

17.96 

2 

21.97 

155.98 

20.758 

156.435 

0.0 

-0.18 

-1.0 

28.16 

3 

22.17 

155.64 

20.700 

156.560 

0.0 

-0.16 

-1.0 

35.47 

4 

22.30 

155.40 

20.750 

156.480 

0.0 

-0.16 

-1.0 

37.82 

5 

22.46 

155.01 

20.740 

156.550 

0.0 

0.00 

-1.0 

13.37 

6 

22.53 

154.81 

20.725 

156.425 

0.0 

0.00 

-1.0 

44.80 

7 

22.62 

154.59 

20.740 

156.455 

0.0 

0.14 

-1.0 

17.31 

8 

22.66 

154.45 

20.712 

156.425 

0.0 

0.08 

-1.0 

48.79 

9 

22.85 

153.80 

20.841 

156.400 

0.0 

0.08  j 

-1.0 

53,16 

10 

22.97 

153.28 

20.870 

156.400 

0.0 

0.23 

-1.0 

57.27 

11 

23.01 

152.98 

20.700 

156.300 

0.0 

0.14 

1  -1.0 

59.61 

12 

23.09 

152.38 

20.760 

156.460 

0.0 

0.31 

I  -1.0 

63.24 

Figures23~30  provide  the  supporting  “study  of  the  sequence  and  result  in  t  he  final  analysis 


table  below. 

image  # 

Figure  22  shows  the  area  chosen  for  the  study. 

Results  of  Cloudiness  vs  Viewing  Angle  Study 

gradient  mean  sigma  mean-.5<r  percent 

cutoff  gray  (<r)  gray  level  cloudiness 

level 

_ _  _ L  1 

angle 
in  degrees 

1 

58=90.28% 

159 

46.0  ~ 

136 

32.26% 

17.96 

2 

60=90.02 

156 

48,5 

132 

38.99 

28.1 6 

3 

59=89.91 

163 

48.4 

139 

44.84 

35.47 

4 

45=89.90 

135 

39.7 

115 

42,55 

37,82 

5 

61=90.00 

174 

48.9 

150 

51.80 

43.37 

6 

51=90.03 

168 

44.7 

146 

51.02 

44.80 

7 

V  90.13 

184 

43.6 

162 

52.63 

17.34 

8 

45=90.26 

181 

41.8 

160 

55.28 

1.8.79 

9 

51=90.12 

188 

43.4 

166 

60.19 

53. 16 

10 

54  =  90.12 

186 

43.0 

164 

60,36 

57.27 

11 

40=90.17 

203 

35,5 

185 

70,30 

59.61 

12 

66  =  89.97  j 

180 

47.3 

156 

73. 75 

63.2  1 

The  plots  for  the  navigation  track  of  the  shuttle  and  final  study  of  cloudiness  vs  viewing 


angle  are  given  in  Figures  9  and  21  respectively. 
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APPENDIX  B 

Gran  Canary  sequence 


The  complete  analysis  described  in  the  report  was  also  performed  on  a  sequence  of  images 
taken  during  space  shuttle  mission  51C  over  Gran  Canary  Island.  Twenty  images  were  taken 
and  navigation  analysis  produced  a  following  table 

Flight  51D  Shuttle  “Discovery" 


265  km  orbit 


image  # 

camera 

target 

camera  up  \ 

ector 

angle 

lat  (N) 

long  (W) 

lat  (N) 

long  (W) 

X 

Y 

Z 

in  degrees 

6 

27.63 

16.700 

27.850 

15.560 

0.0 

-0.7 

0.05 

24.10 

5 

27.63 

16.500 

27.840 

15.560 

0.0 

-0.7 

0.05 

20.63 

4 

27.62 

16.200 

27.860 

15.575 

0.0 

-0.7 

0.05 

14. HO 

3 

27.64 

15.597 

27.835 

15.597 

0.0 

-0.7 

0.10 

4.HH 

1 

27.62 

14.950 

27.790 

15.460 

0.0 

-0.7 

0.17 

11.93 

7 

27.63 

14.200 

27.880 

15.500 

0.0 

-0.7 

0.05 

27.37 

8 

27.63 

14.100 

27.858 

15.535 

0.0 

-0.7 

0.11 

29.59 

9 

27.64 

13.7.50 

27.875 

15.600 

0.0 

-0.7 

0.13 

36.17 

11 

27.63 

12.700 

27.850 

15.520 

0.0 

-0.7 

0.16 

48.30 

12 

27.62 

12.300 

27.865 

15.500 

0.0 

-0.7 

0.16 

52.06 

Analysis  of  this  sequence  varied  from  the  previous,  two  separate  areas  were  taken  from 
this  sequence.  One  area  was  over  clearly  over  water  and  another  over  land.  The  areas  are 
indicated  in  Figures  and  32 .  Figures  33-^7  provide  the  supporting  study  of  the  sequence 
and  result  in  the  final  analysis  tables  below  for  two  areas  indicated. 


Results  of  Cloudiness  vs  Viewing  Angle  Study 


Gran  Canary  Island  clouds  over  WATER 


image  # 

gradient 

mean 

sigma 

mean-.5cr 

percent 

angle 

cutoff 

gray 

level 

(<r) 

gray  level 

cloudiness 

in  degre 

6 

65=90.12% 

183 

40.1 

163 

28.82% 

27.37 

5 

53=90.08 

172 

45.7 

149 

27.25 

20.63 

4 

51  =  89.89 

170 

44.6 

148 

24.80 

14.80 

3 

48=89.97 

166 

45.7 

143 

21.77 

4.88 

1 

91=90.16 

173 

45.7 

150 

24.05 

1  1 .93 

7 

49  =  90.01 

151 

48.8 

127 

28.43 

24.80 

8 

52=90.00 

152 

44.7 

130 

29.10 

29.59 

9 

53=90.21 

170 

44.5 

148 

31.50 

36.17 

11 

54=90.04 

173 

41.4 

152 

35.90 

48.30 

12 

54  =  90.18 

188 

38.4 

169 

38.15 

52.00 
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Results  of  Cloudiness  vs  Viewing  Angle  Study 
Gran  Canary  Island  clouds  over  LAND 


image  ii 

gradient 

cutoff 

mean 

gray 

level 

sigma 

(*) 

mean-.5<r 
gray  level 

percent 

cloudiness 

angle 
in  degrees 

6 

64  =  90.20% 

179 

46.3 

156 

36.91% 

27.37 

5 

64  =  90.00 

176 

47.8 

152 

34.24 

20.63 

1 

62=90.00 

171 

47.3 

147 

32.68 

14.80 

3 

54=89.85 

152 

43.9 

130 

27.03 

4.88 

1 

62=90.17 

180 

46.0 

157 

31.92 

11.93 

/ 

62=90.25 

177 

45.1 

154 

37.15 

24.80 

8 

63=89.90 

177 

44.3 

155 

38.35 

29.59 

9 

65=90.19 

178 

45.2 

155 

42.12 

36.17 

1  I 

67=89.90 

185 

42.3 

164 

49.71 

48.30 

12  j  63  =  90.09 

192 

40.0 

172 

55.98 

52.06 

The  plots  for  the  navigation  track  of  the  shuttle  and  final  study  of  cloudiness  vs  viewing 
nglr  are  given  in  Figures  9  and  21  respectively. 

The  results  produced  apply  to  regions  over  water  and  over  land. 
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APPENDIX  C 


I 

(FROM  THE  PHASE  I  PROPOSAL) 


Digitization  Principles 

The  digitization  of  the  shuttle  black  and  white  transparencies  is  to  be  carried  out  on  an 
Optronics  P-300  scanner  connected  to  the  bus  of  a  MicroVAX  II.  A  brief  discript  ion  of  the 
digitization  technique  used  by  the  Optronics  scanner  follows. 

Rasterization  Procedure 

Typically,  a  laser  beam  is  directed  along  the  axis  of  a  lathelike  rotating  drum  mechanical 
assembly.  A  45°  angled  mirror  redirects  the  beam  at  90°  to  the  axis  so  that  it  shines  onto 
the  inner  surface  of  the  rotating  drum.  A  window  in  the  drum  allows  the  beam  to  pass  out 
from  the  drum  for  some  fraction  of  each  revolution.  As  the  beam  exits  the  drum,  it  impinge*, 
onto  a  light  detector,  producing  an  electrical  signal.  A  clear  window  produces  a  square  wave 
output  signal  from  the  detector  as  the  drum  rotates.  By  inserting  a  photo  transparency  over 
this  drum  window,  the  laser  beam  is  caused  to  scan  a  line  across  the  photo;  thus  the  signal 
from  the  detector  is  modulated  by  the  variation  in  photographic  density  from  point  to  point 
along  this  scan  line.  Opaque  points  let  little  light  reach  the  detector,  whereas  clear  points 
on  the  photo  diminish  the  light  transmission  only  slightly. 

If  the  drum  is  allowed  to  move  along  the  axis  very  slowly,  a  raster  pat  tern  will  he  scanned 
over  the  entire  window,  one  line  per  drum  rotation.  The  amount  of  movement  along  the  axis 
per  drum  rotation  is  chosen  to  match  the  beam  diameter  at  the  window,  and  the  beam  is 
brought  to  a  focus  using  a  lens  assembly  with  the  focal  point  at  the  film  surface.  The  analog 
signal  from  the  detector  element  is  amplified  and  sampled  to  break  it  into  pixels,  ami  each 
sample  is  quantized  by  an  analog-to-digital  computer.  The  results  are  transmitted  into  the 
computer  over  a  high-speed  connection. 

Data  Encoding 

The  resolution  of  the  Optronics  scanner  can  vary  from  12.5  microns  to  500  microns. 
Thus,  for  a  standard  35mm  transparency  with  an  active  window  of  24mm  by  36mm,  we  have 
a  matrix  of  1920  vertical  by  2880  horizontal  pixel  resolution  at  12.5  microns  resolution.  The 
Optronics  P-300  scanner  digitizes  transparancies  into  256  grey  levels. 

To  properly  set.  the  black  and  white  window,  a  large  number  of  training  samples  i* 
required.  When  using  the  scanner  on  a  large  batch  of  film,  it  is  necessary  to  first  scan  the 
entire  batch  in  order  to  adjust  the  threshold.  Then  assuming  that  each  pixel  represent* 
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one  lute  <>f  information,  each  image  is  composed  of  1920>2880  pixels  and  is  roughly  5.5 
megabyte*.  It  such  a  resolution  is  not  sufficient,  then  high  contrast  reproduction  of  the  film 
i'  warranted,  and.  with  a  resulting  slide  of  5  by  5  inches,  virtually  any  resolution  can  be 
obtained  up  to  20.000  pixels  per  scan  line  (such  a  resolution  is  prohibited  by  the  size  of  the 
resulting  image  tile,  however,  which  is  on  the  order  of  350  megabytes). 

1  lie  scan  file  for  each  image  yields  a  run-length  encoded  file  on  the  VAX  computer. 
Our  experience  shows  that  for  temporary  storage  the  run-length  encoding  greatly  saves  disk 
spare  (up  to  50'i  ).  An  illustration  of  the  process  is  provided  in  Appendix  A  of  the  present 
proposal:  a  sample  35mm  color  transparency  of  the  shuttle  photograph  has  been  digitized 
at  50  microns  resolution,  and  one  quarter  of  the  resulting  image  in  256  grey  steps  (original 
image  size  1400-  1400  pixels)  is  also  shown. 

/•  rrors 

All  of  the  steps  in  the  process  of  digitization  described  above  involve  a  certain  degree 
of  uncertainty  and  error.  Simply  finding  the  best  overall  dynamic  range  of  a  group  of 
transparencies  involves  a  lengthy  procedure  of  sampling  and  experimentation.  The  step 
involving  the  change  from  the  analog  signal  of  the  laser  beam  to  the  sampled  digital  signal 
varies  in  allowed  errors,  depending  on  the  resolution  of  the  step,  thus  allowing  for  a  trade-off. 
(  here  are  a  number  of  choices  to  be  made  in  search  of  the  best  combination  for  scanning, 
e  g.,  the  problem  of  scanning  an  image  at  too  high  resolution  and  coming  up  with  the  actual 
grains  of  the  him  instead  of  meaningful  information.  Our  goal  in  the  Phase  I  effort  and 
even  more  so  in  lurther  work  is  to  develop  a  knowledge-based  system  that  will  govern  work 
with  different  sets  of  images  and  will  help  to  determine  automatically  the  most  appropriate 
techniques  and  procedures. 


